Digital imaging system and file format providing raw and processed image data

ABSTRACT

An electronic image capture device for capturing a color image, comprising an image sensor comprised of discrete light sensitive picture elements overlaid with a color filter array (CFA) pattern to produce sensor color image data corresponding to the CFA pattern; an A/D converter for producing uninterpolated digital CFA image data from the sensor color image data; a processor for processing the uninterpolated digital CFA image data to produce interpolated image data and for forming a TIFF image file containing both the uninterpolated CFA image data and the interpolated image data; and a memory for storing the TIFF image file.

CROSS REFERENCE TO RELATED APPLICATIONS

This patent is a continuation-in-part of the U.S. Ser. No. 10/394,598,filed Mar. 21, 2003, published Sep. 25, 2003, No. 2003/0179297; which isa continuation of U.S. Ser. No. 09/048,622, now U.S. Pat. No. 6,567,119,issued May 20, 2003; which is a CPA of U.S. Ser. No. 09/048,622, filedMar. 26, 1998, now abandoned.

FIELD OF THE INVENTION

The invention relates generally to the field of electronic photography,and in particular to an electronic imaging system of the type thatgenerates a standard format file.

BACKGROUND OF THE INVENTION

A typical digital camera uses a single color image sensor to capture arepresentation of a scene, including a representation of the color inthe scene. The colors are separated by a color filter array (CFA) thatoverlies the sensor and associates each image pixel with a particularcolor according to the particular color pattern of the CFA. For example,the Bayer CFA (described in U.S. Pat. No. 3,971,065) provides an RGBpattern with a checkerboard arrangement of green pixel sites. Therefore,the primary CFA image signal for each pixel relates to but one color,that is, to either red, green or blue (for a Bayer CFA). After the CFAimage is captured, the remaining (missing) colors for each pixel siteare interpolated for each pixel from, e.g., surrounding pixels, so thata full resolution interpolated record is generated for each image. Eachpixel in the interpolated record therefore has a set of RGB values.

For many years, some types of digital cameras, such as the Kodak DC50camera introduced in 1995, have stored the CFA image data as a “raw”TIFF image file on a removable memory card. Such a file is called a“raw” file because significant image processing, including CFAinterpolation, is required before the image can be displayed or printed.The well-known TIFF (Tag Image File Format) allows different types ofimage data, including CFA image data, to be stored using a standardimage file wrapper. ISO 12234-2:2001, Electronic still-pictureimaging—Removable memory—Part 2: TIFF/EP image data format standardizesthe way in which CFA image data, and metadata tags that specify thecolor arrangement of the CFA, can be stored within a TIFF file. However,before such a “raw” file can be displayed or printed, it must beinterpolated and converted to standard color image data, such as sRGBcolor image data. This standard color image data can be displayed orprinted, or can be compressed and stored using a standard file format,such as for example a JPEG file format, a JPEG 2000 file format, or aFlashPix file format.

The process used to convert the image to a standard file format, and toprint and edit the standard format, is shown in FIG. 1. The CFA image iscaptured in a capture step 10 by the camera. When the camera or memoryis connected to a host computer in a connect step 12, the images aredownloaded from the camera or memory card in a downloading step 14,processed in a processing step 16 and stored in a standard file formatin a file formatting step 18. In the processing step 16, the CFA imagesare CFA interpolated as they are imported, using known CFAinterpolation, color correction, and sharpening techniques, in order tocreate a “finished” RGB image file having a standard size. The finishedRGB image file thus contains the CFA interpolated image, which has thesame number of total pixels as the original image. Unlike the originalimage, however, the CFA interpolated image has complete RGB data foreach pixel.

The advantage of using a standard file format is that it allows theimage to be used by many different image software programs, photoprinters, retail photo kiosks, and Internet based printing servicessupplied by many different companies. For this reason, most currentdigital cameras include a mode that produces and stores standard imagefiles, such as JPEG image files. These image files are produced in thedigital camera as the images are captured.

Many different standard image file formats are known and useful withthis invention. One example of such a standard image file is a FlashPixfile. FIG. 2 is a simplified diagram showing the key information storedin a FlashPix file. The FlashPix image format (defined in FlashPixFormat Specification, version 1.1, (Digital Imaging Group, Jul. 10,1997)) has been developed to serve as both an “interchange” formatbetween devices (e.g. cameras) and applications (e.g. computer pictureediting packages), and as a “native” format for image editing thatallows the images to be easily and rapidly edited. This is accomplishedusing a hierarchical, tiled image representation within a “structuredstorage” file. Referring to FIG. 2, a FlashPix file contains thecomplete image data 24 plus a hierarchy of several lower-resolutioncopies within the same file (one set of lower resolution image data 25is shown in FIG. 2).

Images at each resolution also are divided into rectangular tiles (e.g.,squares), which enable the application to minimize the amount of imagedata processed to access, display or print a portion of the scenecontent. FlashPix allows thumbnail image data 23 and optional“ancillary” property set data 21 and 22 to be stored in the samestructured storage file, along with the image data. This ancillary datacan include digital audio recordings and parameters such as the time anddate the photo was taken, the camera zoom position and focus distance,the scene illumination level, camera calibration data, image copyrightowner, etc. For further information about the FlashPix image format seethe aforementioned FlashPix Format Specification, version 1.1, (DigitalImaging Group, Jul. 10, 1997), which is available on the Wide World Webat http://www.i3a.org, and is incorporated herein by reference.

The image processing used to “finish” the image prior to storing thefinished data in the FlashPix file includes operations such as CFAinterpolation, color correction, and image sharpening. The output imagesare normally stored in a standard color space, such as the sRGB spacewhich is supported by the FlashPix image format. As a consequence ofgenerating the image file, the original camera data is discarded (step26). If an image is to be printed or transmitted in an application step28, the standard file format is first edited in an editing step 27.

To create final printed images, the finished image file may be adjustedby the user via an image processing program to create a final outputimage of the desired size, which may include only a “cropped”, coloradjusted portion of the image captured by the camera, or may, e.g.,include multiple images in a “montage”. More specifically, to providethe appropriately sized output image, the image processing program firstcrops the 750×500 RGB CFA interpolated image data, and then uses anotherinterpolation algorithm in the editing step 27 to convert from thecropped version of the “finished” RGB image file to the final desiredoutput image.

Note that this prior art approach uses two interpolation steps, one(step 16) to interpolate “missing” RGB data from the image sensor whilemaintaining the 750×500 pixel data array, and a second (step 27) tointerpolate from the selected crop to the pixel data array that providesthe desired output size. The user therefore selects the final print size(for example 8″×10″), and the image is interpolated up to produce animage data record of appropriate size for the printer. For example, ifthe output device printed at 200 pixels per inch, the image data wouldbe interpolated to 1600×2000 pixels by the computer or the printer, (andoptionally sharpened) to produce the desired image size. In addition,this known approach often uses two separate sharpening operations, oneon the 750×500 pixel CFA interpolated image data following the CFAinterpolation step 16, and a second one on the interpolated 1 600×2000pixel image data array just prior to printing.

The prior art approach has a number of problems. First, the process ofconverting the image from the CFA image data (which may for exampleproduce 12 bit per color data) to the 8 bit per color (24 bit per pixel)sRGB color space may limit the quality of certain images, by reducingthe color gamut and dynamic range of the captured image. Second, the twointerpolation steps (the CFA interpolation that produces a standard sizeimage and the interpolation in the computer or printer that produces thedesired print size) provide more interpolation artifacts than would beproduced using a single interpolation step that interpolates from thesensor CFA data directly to the output image data sent to the printer.Finally, using two separate sharpening steps can also produce artifacts.

What is needed is a digital camera and a digital imaging system thatmaintains the advantages of using a standard, “finished” image fileformat so that the images can be used by many applications, yet alsoenables certain types of devices, including image editing software, toaccess the raw camera data in order to provide improved image qualitywhen editing and printing the images.

SUMMARY OF THE INVENTION

The present invention is directed to overcoming one or more of theproblems set forth above. Briefly summarized, according to one aspect ofthe present invention, an electronic camera for capturing a color image,comprises an image sensor comprised of discrete light sensitive pictureelements overlaid with a color filter array (CFA) pattern to producesensor color image data corresponding to the CFA pattern; an A/Dconverter for producing uninterpolated digital CFA image data from thesensor color image data; a processor for processing the uninterpolateddigital CFA image data to produce interpolated image data and forforming a TIFF image file containing both the uninterpolated CFA imagedata and the interpolated image data; and a memory for storing the TIFFimage file.

In accordance with another aspect of the present invention there isprovided a single image file for storing images obtained from a colorimage capture device having an image sensor overlaid with a color filterarray (CFA) pattern to produce uninterpolated CFA image datacorresponding to the CFA pattern, the CFA image data subject to furtherprocessing to form interpolated and compressed image data, said singleimage file comprising: a first file area for storing the uninterpolatedCFA image data; a second file area for storing the interpolated andcompressed image data as JPEG image data within the single image file;and a third file area for storing a first image processing parameterused to produce the interpolated and compressed image data.

In accordance with yet another aspect of the invention there is provideda method for capturing and processing color images, said methodcomprising:

(a) in a digital image capture device, capturing an array of pictureelements through a color filter array (CFA) and producing CFA imagedata; color image data corresponding to the CFA pattern;

(b) processing the CFA image data using image processing parameter(s)stored in the digital image capture device to produce interpolated imagedata;

(c) storing a single image file in a memory of the digital image capturedevice, the single image file including the CFA image data, theinterpolated image data, and the image processing parameter(s);

(d) transferring the single image file to a second device;

(e) determining whether the second device is capable of processing theCFA image data; and

(f) if the second device is capable of processing the CFA image data,accessing the CFA image data and the image processing parameter(s) inthe single image file.

An advantage of the present invention is that the raw TIFF image file,which can be used/edited by raw image editing enabled applicationsoftware like other raw files, also contains a standard finished fileimage, which can be extracted from the TIFF file and used for immediatedisplay just like any standard image file.

These and other aspects, objects, features and advantages of the presentinvention will be more clearly understood and appreciated from a reviewof the following detailed description of the preferred embodiments andappended claims, and by reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a flow diagram of a known technique for capturing andprocessing image data;

FIG. 2 is an illustration of the well known FlashPix file format;

FIG. 3 is a block diagram of an electronic imaging system capable ofstorage and selective transmission of processed and unprocessed imagedata according to the invention;

FIG. 4 is a flow diagram showing storage and selective transmission andprocessing of processed and unprocessed image data according to theinvention;

FIG. 5 is an illustration of a FlashPix file format incorporatingextension data according to the invention;

FIG. 6 is an illustration of a JPEG interchange file formatincorporating extension data according to the invention;

FIG. 7 is a block diagram of an electronic imaging system showing afurther embodiment of the invention;

FIG. 8 is a block diagram depicting an example of the image processingoperations that can be performed to produce an image file providing rawand compressed image data;

FIG. 9 is an illustration of a TIFF image file containing RAW imagedata, JPEG compressed image data, and image processing parametermetadata; and

FIG. 10 is a flow diagram showing a method of implementing the presentinvention using the system of FIG. 7.

DETAILED DESCRIPTION OF THE INVENTION

Because digital cameras employing electronic sensors, and electronicprocessing and storage of the resultant image data are well known, thepresent description will be directed in particular to elements formingpart of, or cooperating more directly with, apparatus in accordance withthe present invention. Elements not specifically shown or describedherein may be selected from those known in the art. Certain aspects ofthe embodiments to be described may be provided in software. Given thesystem as described in the following materials, all such softwareimplementation needed to practice the invention is conventional andwithin the ordinary skill in such arts.

Beginning with FIG. 3, a system block diagram shows a camera 30 and ahost computer 32. The camera 30 includes an optical section 34 fordirecting image light upon an image sensor 36, typically a single imagesensor such as a charge-coupled device (CCD). The image sensor 36includes an array of discrete light sensitive picture elements; e.g.,having 750×500 pixels, overlaid with a color filter array (CFA) patternto produce color image data corresponding to the CFA pattern. Theoptical section includes a lens 38 and a shutter-aperture device 40 forregulating the exposure of the image light upon the image sensor 36. Aclock generator and driver circuit 42 provides the waveforms necessaryfor generating the color image data from the image sensor 36, and theoutput data is applied to an analog signal processing (ASP) and a 12-bitanalog/digital (A/D) conversion section 44, which produces digital CFAdata from the color image data.

The resultant digital data is applied to a digital signal processor 46,which may compress the image data using, e.g., a numerically lossless orvisually lossless compression technique employing, e.g., DPCM coding,and otherwise process the image data for storage. The processed digitalCFA data is applied to a removable memory 50 via an output interface 48.In operation, the CFA image data represents an image of a fixed size,usually an image substantially corresponding to the actual size of theimage sensor 36. Consequently, the memory 50 stores the digital CFAimage data from a fixed number of picture elements corresponding to thisfixed image size. Moreover, the digital CFA image data stored in thememory 50 may be contained within an image file that also describes thetype of color filter array pattern used on the image sensor, as well asa low resolution thumbnail version of the captured image.

The output interface 48 is a memory card interface 48 a adapted to aconventional card interface standard, such as the PCMCIA card interfacestandard, such as described in the PC Card Standard, published by ThePersonal Computer Memory Card International Association, Sunnyvale,Calif., March 1997. The removable memory 50 accordingly is anon-volatile PCMCIA memory card containing either solid state memory,such as Flash EPROM memory, or a small hard drive (categorized as aPCMCIA-ATA Type III Hard Drive under the PCMCIA card interfacestandard). Another card interface standard is the CompactFlash ATA withDOS file format. Alternatively, other non-volatile storage devices maybe used, such as a floppy disk magnetic medium or optical storage (insuch cases, a suitable interface and a conventional read/write apparatuswould be provided in the camera 30, e.g., a magnetic or opticalread/write head).

In addition, the camera includes a host computer interface driver 52 fordirectly connecting the camera 30 to the host computer 32, for example,to download the digital CFA data corresponding to the captured images.(In this process, the removable memory 50 may serve as a buffer memoryor a separate buffer memory (not shown) may be provided.) The camera 30further includes a control processor 54 for controlling (a) the clockgenerator and driver circuit 42, (b) the digital signal processing chaincomprising the ASP and A/D section 44, the digital signal processor 46and the output interface 48, and (c) the interface driver 52. Theinterface driver 52 provides a conventional computer interface, such asa SCSI, IEEE-1394, USB, Firewire or RS-232 interface. Consequently, thedigital CFA data from the camera 30 interfaces with the host computer 32either through the interface driver 52, or through a card reader 56 thatreceives the removable memory 50.

In order to produce an output image, the host computer 32 includesapplication programs for processing the captured images and producing asoft copy on a display 58 or a hard copy on a printer 60 (or, e.g., afilm writer or the like). For example, the application program (notshown) includes an algorithm section, which applies direct pixelmapping/cropping concurrent with CFA interpolation. The computeradditionally includes a user interface (not shown) that provides useroperated means for cropping to an output image size that uses a subsetof pixels from the fixed image size provided by the camera. Theapplication program then interpolates full color data for each pictureelement of the output image from the cropped picture elements andproduces an interpolated output image having the selected output imagesize. The host computer 32 may be further connected through atransmission link 70 (e.g., internet) to a remote computer 72 and aremote output device 74, such as a hard copy printer.

Operation of the imaging system according to the invention is shown inthe flow diagram of FIG. 4, and a representation of the image formatused with this invention is shown in FIG. 5. As described in connectionwith FIG. 1, the user operates the camera to take pictures in thecapture step 10, and then connects the camera or the card to the hostcomputer in the connect step 12. The user selects the images(s) to beprocessed and converted to the finished file format, such as theFlashPix format, in the downloading step 14. To create the finishedimage data, the 750×500 Bayer pattern CFA image data from the camera isdecompressed and interpolated as described in connection with theprocessing step 16 shown in FIG. 1, to produce CFA interpolated, colorcorrected, sRGB image data, which then can be stored during the fileformatting step 18 in the tiled, hierarchical FlashPix file in thecomplete image field 24 and also in the lower resolution image field 25.

In accordance with the invention, a file format extension step 80 isprovided in which the original 12-bit compressed CFA data is also storedwithin the same FlashPix file as the tiled image data, but in a CFAimage data field 94 in the extension property set 22. More specifically(in reference to FIG. 5), the extension property set includes CFApattern and compression method data 92, CFA image data 94, a camera ICCprofile 96, thumbnail image data 98, and an advanced edits list 100.Accordingly, the extension data may include metadata that provides theCFA pattern used on the image sensor 36 and the compression method usedby the digital signal processor 46, which is stored in the CFA patternand compression method data 92. The camera MTF (modulation transferfunction) values may be stored as a table in the MTF data 95. An ICC(International Color Consortium) profile, which characterizes the colorof the CFA data stored in the extension property set 22, may be storedin the ICC profile 96. Note that this is a different ICC profile thanthe optional profile used within the FlashPix image file to describe thesRGB color data. In the standard usage of the FlashPix format, if thestandard file format should be edited in an editing step 82, simplemodifications (such as rotate, crop, and sharpen) do not modify theimage data 24, 25. Rather, the list of modifications is recorded in theviewing parameters set 20, and the standard thumbnail data 23 ismodified as well. More complex modifications, such as red-eye removal,require that portions of the image data be modified. To record thesemodifications so that they can later be applied to the CFA image data94, the metadata lists this editing data in the advanced edits list 100to describe edits performed by an applications program other thanmodifying the standard FlashPix viewing parameters. In addition, themetadata may also include a copy of the unmodified thumbnail image inthe thumbnail image data 98, which can be compared to the modifiedthumbnail image data 23 to determine if any changes have been made tothe original image data by subsequent image editing applications.

As explained above, if an image file is modified by the application, forexample, by cropping, or adjusting the color or brightness of the image,the CFA image data 94 may no longer properly represent the edited image.In the FlashPix image format, a mechanism is specified that enables anapplication to determine the validity of ancillary data (such as the CFAimage data 94) stored in an extension property set within a FlashPixfile. Such an extension set is further described in U.S. Pat. No.5,983,229, issued Nov. 9, 1999, assigned to the assignee of the presentapplication. According to this patent, the extensions contain a fieldfor indicating an extension persistence property. The extensionpersistence property indicates the validity of the extension data as afunction of whether or not the core elements of the file are modified.The values for the extension persistence property, and theircorresponding meanings, are as follows:

Value Meaning

-   0x0 Extension is valid and remains in the file independent of    modifications to the core elements of the file.-   0x1 Extension is invalid upon any modification to the core elements    of the file, and must be removed from the file when core elements    are edited.-   0x2 Extension is potentially invalid upon modification to the core    elements of the file, and must remain in the file until an    application that understands the extension can determine if the    extension is valid (remains in the file) or invalid (removed from    the file).

The extension persistence value for the extension property set 22,according to the present invention, is set as 0x2 to indicate that theextension data (such as the CFA image data 94) is potentially invalidupon modification to the core elements of the file. The extensionproperty set 22 therefore remains in the FlashPix file until anapplication that understands the extension can determine if theextension is valid or invalid.

The FlashPix file containing this extension data can now be used by anyFlashPix enabled application, including applications that do notunderstand the meaning of the data within extension property set 22.More specifically, referring to FIG. 4, the file containing theextension data may be transmitted to a printing stage (step 84) via alocal linkage 86 or via a remote linkage 88, in which case the extensiondata may be separated from the file (step 90) and sent to the printingstage (step 84). The image may be changed in a number of ways, e.g.,cropped, lightened, and processed for red-eye removal. In some cases,(e.g., cropping, lightening) these changes can be done by adjusting theviewing parameters 20 in the FlashPix file, rather than by modifying theimage data 24, 25. In all cases, however, the applications programmodifies the standard FlashPix thumbnail image data 23 to accuratelyreflect the image modifications.

When the image data is printed by an “old” printer that does notunderstand the meaning of the extension property set 22, the standardFlashPix image data is printed the same way as in the prior art. If theprinting application understands the extension property set 22, however,it normally processes the CFA image data stored in the extension toprovide the data to be printed. This is done as described in U.S. Pat.No. 6,650,366, issued Nov. 18, 2003. In this application, the “original”image data (which is optionally compressed using a numerically losslessor visually lossless technique) is stored in a digital image file on adigital memory and transferred to the host computer. This image file isretained until a final rendered image is created. A “soft copy” qualityversion of the image can be displayed to the user, who can decide tocrop the image and to create an output image of any size to be printed,incorporated into other documents, etc. The advantage is this: To createthe final high quality image, the cropped portion of the original pixeldata is directly interpolated (and optionally sharpened) in a singlestage to create the proper output image size. By directly mapping theinput pixels to the desired output pixels in a single stage thatincludes CFA interpolation, interpolation artifacts are minimized. Inaddition, if the image is sharpened in this stage, the sharpness of theoutput image is improved without degradation from artifacts due tomultiple sharpening stages.

Accordingly, the 750×500 Bayer pattern digital CFA image data from thecamera is decompressed and cropped as specified by the user, for examplea 256×256 square portion of the image may be used. The CFA interpolationand spatial processing are then combined in a single processing step, asshown in more detail in U.S. Pat. No. 6,650,366, to produce the finaloutput image data, which could be a larger square image, e.g., 1024×1024pixel image. The CFA interpolation step may practice any of a number ofknown interpolation techniques. For instance the interpolationtechniques in the following patents may be used: U.S. Pat. No.5,373,322; U.S. Pat. No. 5,382,976; U.S. Pat. No. 5,506,619; and U.S.Pat. No. 5,629,734. Each of these patents is incorporated herein byreference.

After the final size image record is interpolated, the image issharpened in a single sharpening step. This sharpening may use thetechnique described in U.S. Pat. No. 5,696,850, incorporated herein byreference. This patent uses a modulation transfer function (MTF)calibration data 95 from the camera and the printer MTF data (not shown)to determine the appropriate sharpening filter for optimally sharpeningdigital reproductions of any size taken by an electronic camera. Theimage data is finally printed out in hardcopy form in the hardcopyprinter 60 or in the remote printer 74 (FIG. 3).

To ensure that the image data in the file has not been altered by animage processing application (which, for example, might have implemented“red eye” reduction or the like), the original thumbnail image data 98in the extension property set 22 is processed by applying any viewingparameters 20 contained in the FlashPix file (or any advanced edits 100contained in the extension property set 22) and comparing the resultwith the standard thumbnail image 23 in the same file. If the two imagesare different, this indicates that the original image data has beenmodified in an unknown way and that the CFA image data 94 should not beused to make the output print image. In this case, the output print ismade using the standard FlashPix image data 24, as in the case where an“older” printer is not aware of the extension data.

Many applications are able to open images stored in “JPEG interchangeformat” (JEF) files defined by the Baseline DCT (JPEG) version ofISO/IEC 10918-1, which is incorporated herein by reference. Thisstandard allows “application segments” to be included in the JIFbitstream. The data inside an application segment is ignored byapplications that are not familiar with the meaning of the data in theapplication segment. A number of image file formats have been developedwhich use a single application segment to store ancillary data and areduced-resolution “thumbnail” image. These image formats include JFIF,defined in “JPEG File Interchange Format Version 1.02 Sep. 1, 1992C-Cube Microsystems”, the JPEG compressed version of Exif (Exchangeableimage format) described in “Digital Still Camera Image File FormatProposal (Exif) Version 1.0 Mar. 24, 1995 JEIDA/Electronic Still CameraWorking Group” and SPIFF, defined in “ITU-T Rec. T.84, Annex F—StillPicture Interchange File Format, 1995”, which are each incorporatedherein by reference.

In a second embodiment shown in FIG. 6, a JPEG interchange format fileis used. The file contains a complete JPEG data stream which is validaccording to the ISO JPEG standard (ISO/IEC 10918-1). The fields citedin FIG. 6 are identified as follows:

SOI=start of image

APP=application segment

DQT=define quantization tables

DHT=define huffman tables

SOF=start of frame

SOS=start of scan

EOI=end of image

More specifically, the JPEG data stream also includes an applicationsegment 102 (application segment 7 (APP7), in this example) thatincludes the same type of information as stored in the FlashPixextension property set 22, as described in connection with FIG. 5.

FIG. 7 through FIG. 10 relate to a further embodiment of the presentinvention. In this embodiment, the uninterpolated image data from theimage sensor 36 is stored as so-called “raw” camera data using the TIFFimage format. This TIFF image file is fully compatible with the TIFF-EPstandard, defined in ISO 12234-2:2001, which is available from theInternational Standards Organization in Geneva, Switzerland.

One problem with using normal TIFF-EP raw files is that all applicationsmust perform the processing needed to convert the raw data intointerpolated data, prior to display or printing. Different digitalcameras use different types of interpolation processing, it is difficultto provide processing for all such cameras within an image displayapplication, image editing application or digital printer.

Because TIFF files can support multiple images within a single file, theinventors of the present invention have recognized that a “finished”processed and compressed JPEG image can be provided within a TIFF-EPfile, while still maintaining compatibility with the TIFF-EP standard.The JPEG image data within the TIFF file can be used to enablecompatibility with devices (such as computer software applications orhome photo printers) that are not able to process a “raw” camera file.The raw image data only needs to be accessed by the image is to bemodified by an image editor FIG. 7 is a block diagram of an additionalembodiment of an electronic imaging system according to the presentinvention. The electronic imaging system includes a camera 30A, whichcaptures and stores images on a removable memory card 50A. As describedearlier in reference to FIG. 3, the digital camera 30A includes anoptical section 34 for directing image light upon an image sensor 36,preferably a single color image sensor such as a charge-coupled device(CCD) or CMOS image sensor. The image sensor 36 includes an array ofdiscrete light sensitive picture elements overlaid with a color filterarray (CFA) pattern to produce color image data corresponding to the CFApattern. The image sensor 36 can have, for example, a 4:3 image aspectratio and a total of 3.1 effective megapixels (million pixels), with2048 active columns of pixels×1536 active rows of pixels. The imagesensor 36 can use a ½″ type optical format, so that each pixel isapproximately 3.1 microns tall by 3.1 microns wide.

The optical section 34 includes a zoom lens 38A and a shutter-aperturedevice 40 for regulating the exposure of the image light upon the imagesensor 36. A clock generator and driver circuit 42 provides thewaveforms necessary for generating and transferring the color image datafrom the image sensor 36 to provide sensor output data, and this sensoroutput data is applied to an analog signal processing (ASP) and a 12-bitanalog/digital (A/D) conversion section 44, which produces digital CFAdata from the color image data. The clock generator and driver circuit42 also controls a flash unit for illuminating the scene (not shown)when the ambient illumination is low. If the image sensor 36 is a CMOSimage sensor, the ASP and A/D 44 and the clock generator and driver 42can be included with the image sensor 36 in the same integrated circuit.

The resultant digital data from the ASP and A/D 44 is temporarily storedin a DRAM buffer memory 45, and then applied to the digital signalprocessor 46. The processing performed by the digital signal processor46 is controlled by firmware stored in a firmware memory 128, which canbe flash EPROM memory. It should be noted that the digital signalprocessor 46, while typically a programmable image processor, canalternatively be a hard-wired custom integrated circuit (IC) processor,a general purpose microprocessor, or a combination of hard-wired customIC and programmable processors.

The digital signal processor 46 also interfaces to user controls 134 andprovides color signals to the color display 132. The graphical userinterface displayed on the color display 132 is controlled by the usercontrols 134. After images are captured, they can be reviewed on a colordisplay 132 by using the thumbnail or screennail image data stored in aDRAM 122. The user controls 134 also allow the user to set variouscamera parameters, such as the white balance setting, color setting,sharpness level setting, and compression quality setting.

The user controls 134 can include a zoom control (not shown) thatcontrols the focal length setting of the zoom lens 38A. Once the maximumtelephoto zoom setting has been reached, the digital signal processor 46can crop and resample the image data provided by the image sensor 36 toprovide “digital zoom”, as will be described later in reference to FIG.8.

The camera 30A also includes a gravitational orientation sensor 140. Thegravitational orientation sensor 140 is used to determine whether thecamera is in the normal horizontal “landscape orientation”, a first(clockwise 90 degree rotated) vertical “portrait” orientation, or asecond (counter-clockwise 90 degree rotated) vertical “portrait”orientation at the time the digital image is captured. The signal fromthe gravitational orientation sensor 140 can be used to decide whetheror not the digital signal processor 46 should automatically rotate thecaptured image to the proper “upright” orientation, as described incommonly-assigned U.S. Pat. No. 5,900,909, disclosure of which isincorporated herein by reference.

In some embodiments, the camera 30A can also include a “panoramic” mode,which provides a wide aspect ratio image by using only the central rowsof pixels from the image sensor 36, while discarding the top and bottomrows. This can be done as described in commonly-assigned U.S. Ser. No.11/062,174, filed Feb. 18, 2005, by Labaziewicz, et al., the disclosureof which is incorporated herein by reference.

The digital signal processor processes the captured CFA image data andproduces a digital image file 450 (shown in FIG. 8), as will bedescribed later in reference to FIG. 8. The digital image file 450 isprovided to a memory card interface 48A, which stores the digital imagefile 450 on the removable memory card 50A. Removable memory cards 50Aare one type of removable digital image storage medium, and areavailable in several different physical formats. For example, theremovable memory card 50A can include (without limitation) memory cardsadapted to well-known formats, such as the Compact Flash, SmartMedia,MemoryStick, MMC, SD, or XD memory card formats. Other types ofremovable digital image storage media, such as magnetic hard drives,magnetic tape, or optical disks, can alternatively be used to store thestill and motion digital images. Alternatively, the digital camera 30Acan use internal non-volatile memory (not shown), such as internal FlashEPROM memory to store the processed digital image files. In such anembodiment, the memory card interface 48A and the removable memory card50A are not needed.

The camera 30A includes a dock interface 162 for connecting the camera30A to a dock/recharger 364, which is in turn connected to computer 32A.The dock/recharger 364 can recharge the batteries (not shown) used topower the camera 30A. The dock interface 162 and dock/recharger 364communicate using a conventional computer interface, such as a USB orIEEE-1394 interface. Consequently, the digital image files 450 providedby the digital camera 30A can be transferred to the computer 32A eitherthrough the dock/recharger 364 or through a memory card reader 56A,using the removable memory card 50A.

In order to produce an output image, the host computer 32A includesapplication programs for processing the transferred image files andproducing a soft copy that is displayed on a display 58A, or a hard copythat is printed on a printer 60A. The application program (not shown)processes the raw image data from the image file, to enable the user toadjust various image processing parameters, as will be described laterin reference to FIG. 8. For example, the graphic user interfacedisplayed on the display 58A can include a user control that providesuser operated means for cropping to an output image size that uses asubset of pixels from the fixed image size provided by the camera. Theapplication program then interpolates full color data for each pictureelement of the output image from the cropped picture elements andproduces an interpolated output image having the selected output imagesize. The graphic user interface can also enable the user to adjust thetone reproduction, color reproduction, white balance, noise cleaningsettings, and sharpness of the image.

The computer 32A may be further connected through a transmission link 70(e.g., internet) to a remote computer 72 and a remote output device 74,such as a hard copy printer, as was described earlier in relation toFIG. 3. The removable memory card 50A can also be inserted into a memorycard slot (not shown) in a home photo printer 358 and a retail photoprinter 360.

FIG. 8 is a block diagram depicting an example of the image processingoperations that can be performed by the digital signal processor 46 inthe digital camera 30A to produce an image file 450 providing raw andcompressed image data. FIG. 9 shows an example of the structure of thedigital image file 450.

In block 402 of FIG. 8, the sensor CFA data 400 stored in the DRAMbuffer memory 45 (see FIG. 7), is processed to correct sensor defects.This is done by identifying the defective pixels using a list stored infirmware memory 128 (which was programmed when the camera 30A wasmanufactured), and substituting, for the defective pixel value, acorrection pixel value equal to the average value of the closest,non-defective pixels having the same color.

In block 404, the defect-corrected CFA sensor data is resampled toproduce “small size” raw CFA data, having for example 640 columns×480rows of Bayer pattern pixel data. The resizing can be done by averagingadjacent pixels of the same color.

In block 406, the defect-corrected full size CFA sensor data and thesmall size CFA sensor data are formatted for storage within the digitalimage file 450 shown in FIG. 9, which in a preferred embodiment is aTIFF/EP file. This TIFF/EP file is compliant with ISO 12234-2:2001,Electronic still-picture imaging—Removable memory—Part 2: TIFF/EP imagedata format, incorporated herein by reference.

Referring to FIG. 9, the digital image file 450 includes a TIFF header502, and an Image File Directory O (IFD0) 504 which includes a JPEGInterchange Format tag 506 which points to the portion of the digitalimage file 450 that is used to store the main Exif/JPEG data 510. Thismain Exif/JPEG data 510 includes a main JPEG compressed image 512, aJPEG compressed screennail image 514, and a JPEG compressed thumbnailimage 516. The process used to produce these JPEG compressed images willbe described later in reference to blocks 408-424.

The IFD0 504 also includes an Exif IFD pointer 520, which points tostandard Exif metadata that is stored in ExifIFD 522. The IFD0 504 alsoincludes an Image Processing Parameter IFD Pointer 524, which points toIP ParamIFD 526 that stores the image processing parameters which havebeen used to produce the main Exif/JPEG data 510.

The IFD0 504 also includes a SubIFDPointer 528 which includes a pointerto a Child 0^(th) SubIFD 530 which contains a StripOffset pointer 532that points to the Main CFA Data 536. This Main CFA Data 536 is thesensor defect corrected CFA data from block 402 of FIG. 8.

The SubIFDPointer 528 also includes a pointer to a Child 1^(st) SubIFD540 which contains a StripOffset pointer 542 that points to the SmallSize CFA 544 data. This Small Size CFA 544 data is the CFA imageresampled data from block 404 of FIG. 8. When the digital image file 450is later processed by the computer 32, this small size raw CFA data 544can be used to enable the computer 32A to more quickly produce adisplay-sized processed image on the display 58A, because it has manyfewer pixels to process than if the computer 32A had to process the fullsize CFA image data.

Once the digital image file 450 has been modified on the computer 32 (aswill be described later in reference to FIG. 10), the IFD0 504 can alsoinclude pointers to additional modified JPEG images 570, which are addedto the digital image file 450 when it is saved as a modified image file.For example, the first time the image is modified, the NextIFD pointer550 points to an IFD1 (Main Image Modified JPEG) 552, which contains themain Exif/JPEG data 558 (which is the modified image), as well as apointer to the IPParamIFD 554 which contains the image processingsettings used to produce the modified main Exif/JPEG data 558.

The next time the image file is modified and saved, an IFD2 (Main ImageModified JPEG) 562 is used to store the second modified main Exif/JPEGdata 568, and an IPParamIFD 564 that contains the image processingsettings used to produce this second modified main Exif/JPEG data 568 isadded to the digital image file 450. In addition, a LastIFD Pointer 560is added to IFD0 504, and a NextIFD 556 pointer is added to IFD1 552,both of which point directly to IFD2 562.

Each time the digital image file 450 is subsequently modified and saved,an additional IFD (e.g. IFD3, IFD4, etc.) can be added to the digitalimage file 450, and the LastIFD pointer 560 can be updated to point tothe new IFD.

Returning to FIG. 8, in block 408, the image data is cropped, if thedigital zoom function or the panoramic function has been enabled by theuser, using the user controls 134. This cropping uses the digitalzoom/pan settings 428.

In block 410, the rotated/cropped CFA data is noise cleaned. This noisecleaning uses noise cleaning settings 430 provided as part of the imageprocessing parameters 444. This processing can use the noise cleaningmethod described in commonly-assigned U.S. Pat. No. 6,625,325, to Adamset. al., the disclosure of which is herein incorporated by reference.

In the color sensor demosaicing block 412, the noise filtered CFA datais color interpolated to provide full resolution RGB image data. Theprocessing uses the rotate/resample settings 432. The CFA image data isrotated if necessary, if the gravitational orientation sensor 140indicates that the digital camera 30A was held in a portrait orientationas the image was captured. Also, if the CFA image data was cropped inblock 408 to provide digital zooming, the image is resampled in block412 to produce a full size image file. This can be done using themethods described in commonly assigned U.S. Pat. No. 6,650,366, toParulski, et al., the disclosure of which is herein incorporated byreference.

In block 414, the full resolution RGB data is white balanced, using awhite balance setting 434. The white balance setting 434 can indicate aparticular illuminant (e.g. daylight, tungsten) or an automatic whitebalance mode.

In block 416, the white balanced RGB data is tone scale and colorprocessed. This processing uses tone and color settings 436, which mayidentify one of a plurality of color matrixes and tone modificationcurves. This processing can use the methods described in chapter 12.6“tone scale/color processing” of the Digital Color Imaging Handbook,published in 2003 by CRC Press LLC, Boca Raton, Fla., which isincorporated herein by reference. In particular, the color processingcan use, for example, a 3×3 linear space color correction matrix 20depicted in FIG. 3 of commonly-assigned U.S. Pat. No. 5,189,511, toParulski et al., the disclosure of which is incorporated herein byreference.

In block 418, the processed RGB image data is sharpened, usingsharpening settings 438. The image sharpening processing can utilize themethod described in commonly-assigned U.S. Pat. No. 4,962,419, toHibbard et. al., the disclosure of which is incorporated herein byreference. For example, the sharpening setting can identify one of aplurality of coring lookup tables which provide different amounts ofamplification of the “detail” signal used to sharpen the image.

In block 420, the sharpened image data is JPEG compressed, using thecompression settings 440 which include a compression quality setting.The image compression can use the method described in commonly-assignedU.S. Pat. No. 4,774,574, to Daly et. al., the disclosure of which isincorporated herein by reference. The compression quality setting canidentify one of a plurality of quantization tables, for example, threedifferent tables, for the quantize block 26 in FIG. 1 of the '574patent. These tables provide different quality levels and average filesizes for the JPEG compressed image file.

In block 424, the sharpened image data is resampled to produce a twosmaller size images. This resampling can be accomplished as described incommonly-assigned U.S. Pat. No. 5,164,831, to Kuchta, et al., thedisclosure of which is herein incorporated by reference. These include athumbnail size image having for example 160 rows×120 columns, and ascreennail size image having for example 640 rows×480 columns. In block426, the thumbnail and screennail images are JPEG compressed.

In block 422, the JPEG compressed full resolution “main” image, the JPEGcompressed thumbnail image, and the JPEG compressed screennail image areformatted together in an Exif/JPEG image file, as defined in “DigitalStill Camera Image File Format (Exif)” version 2.1, July 1998 by theJapan Electronics Industries Development Association (JEIDA), Tokyo,Japan. This format includes an Exif application segment that storesparticular image metadata, including the date/time the image wascaptured, as well as the lens f/number and other camera settings. Theresult is the main Exif/JPEG data 510 in FIG. 9.

The digital zoom/pan settings 428, noise cleaning settings 430, whitebalance setting 434, tone and color settings 436, sharpening settings438, and compression settings 440 are all included in the imageprocessing parameters 444. In block 448, these parameters are formattedas TIFF tags that are stored within the Image Processing parameters IFD526 in FIG. 9.

FIG. 10 is a flow diagram showing a method of implementing the presentinvention using the system of FIG. 7

In block 200 of FIG. 7, the user selects the camera capture and imageprocessing parameters 444 (shown in FIG. 8) for the camera 30A. This isdone using the user controls 134, as described earlier in reference toFIG. 7. Some or all of these settings can be default settings stored inthe firmware memory 128 of the camera 30A.

In block 202, the user composes the image using the color display 132,or an optical viewfinder (not shown) on the digital camera 30A.

In block 204, the sensor CFA image data is captured and temporarilystored in the DRAM buffer memory 45.

In block 206, the CFA image sensor data is processed by the digitalsignal processor 46 to produce processed RGB image data, using the imageprocessing parameters 444, as was described earlier in reference toblocks 408 to 418 of FIG. 8.

In block 208, the digital signal processor 46 creates screennail andthumbnail size processed images, as was described earlier in referenceto block 424 of FIG. 8.

In block 210, the main, screennail, and thumbnail images are JPEGcompressed as was described earlier in reference to blocks 420 and 424of FIG. 8.

In block 212, the TIFF tags stored in the IPParamIFD 526 in FIG. 9 arepopulated with the image processing parameters 444, as was describedearlier in reference to block 448 of FIG. 8.

In block 214, the digital image file 450 in FIG. 9, containing the mainCFA image data 536, the small size CFA image data 544, the main imagedata 512, the screennail image data 514, the thumbnail image data 516,and the image processing parameters 444 (stored in IPParamIFD 526) isproduced by the digital signal processor 46.

In block 216, the digital image file 450 is stored on the removablememory card 50A or other memory device.

In block 220, the digital image file 450 is transferred from the camera30A to another device, such as the computer 32A, the retail photoprinter 360, or the home photo printer 358, as was described earlier inreference to FIG. 7.

In block 222, the device that received the transferred digital imagefile 450 determines if it is capable of processing the CFA image data.

In block 224, if the device is not able to process CFA image data (no toblock 222), the device accesses the JPEG/Exif format image data 510 fromwithin the digital image file 450. This allows the device to use theimage as if it were a standard JPEG/Exif image file. This JPEG/Exifimage data can then be displayed, printed, recorded, or transmitted bythe device.

In block 226, if the device is able to process CFA image data (yes toblock 222), the device accesses the main CFA image data 536 from withinthe digital image file 450. The device may also access the small sizeCFA image data 544, in order to quickly produce a viewable image thatcan be interactively modified by the user.

In block 228, the user of the device can modify the image processingparameters 444, if desired. Thus, the user can modify the digitalzoom/pan settings to provide more (or less) cropping. For example, ifthe panoramic setting provided a wide aspect ratio image by cropping outthe top and bottom rows in block 408 of FIG. 8, some or all of theserows can be included in the modified image. As another example, thenoise cleaning thresholds 430 and sharpening settings 438 can bemodified to better balance the noise suppression and image sharpness. Asanother example, if an image was captured with tungsten selected as theilluminant, but the light source was actually daylight, the CFA imagecan be reprocessed, as though daylight was selected in the first place.The exposure and flare can also be adjusted by modifying the tone &color settings 436.

In some embodiments, the user can also be provided with other controlsthat were not included in the digital camera. For example, the controlscould allow the user to independently adjust the scene lighting in theshadows, mid-tones, and highlights of the captured image. Theseadjustments can be previewed using the small size CFA data 544, toreduce the computation time needed to enable the user to interactivelydetermine their preferred image processing settings.

In block 230, the main CFA image data 536 is reprocessed using the usermodified settings. This is similar to repeating blocks 408 through 418of FIG. 8, using different image processing parameters 444.

In block 232, the modified settings and additional processed JPEG filesare stored within the digital image file 450. To provide these JPEGfiles, the reprocessed image data from block 230 is resampled to producethumbnail and screennail images of the modified image, and the main,thumbnail, and screennail images are JPEG compressed and included inIFD1 (Main Image Modified JPEG) 552, which was described earlier inreference to FIG. 9. In addition, the image processing parameters usedto produce the modified image are stored in the IPParamIFD 564.

In an alternative embodiment, instead of adding IFD1 552 and IPParamIFD554 to the digital image file 450 when the image is modified, the mainExif/JPEG data 510 can be replaced with the modified JPEG image data,and the IPParamIFD 526 parameters can be replaced with the modifiedparameters.

In block 234, the modified, processed CFA image data is displayed, forexample using the display 58A, or printed, for example using the printer60A.

The invention has been described with reference to several preferredembodiments. However, it will be appreciated that variations andmodifications can be effected by a person of ordinary skill in the artwithout departing from the scope of the invention.

PARTS LIST

-   10 capture step-   12 connect step-   14 downloading step-   16 processing step-   18 file formatting step-   19 header-   20 viewing parameters-   21 property set data-   22 extension property set data-   23 thumbnail image data-   24 complete image data-   25 lower resolution image data-   26 discard step-   27 editing step-   28 application step-   30 camera-   30A camera-   32 host computer-   32A host computer-   34 optical section-   36 image sensor-   38 lens-   38A zoom lens-   40 shutter-aperture device-   42 clock generator and driver circuit-   44 ASP and A/D section-   45 DRAM buffer memory-   46 digital signal processor-   48 output interface-   48 a memory card interface-   50 removable memory-   50A removable memory-   52 interface driver-   54 control processor-   56 card reader-   56A memory card reader-   58 display-   58A display-   60 hard copy printer-   60A printer-   70 transmission link-   72 remote computer-   74 remote output device-   80 file format extension step-   82 editing step-   84 printing step-   86 local linkage-   88 remote linkage-   90 separation step-   92 CFA pattern and compression method data-   94 CFA image data-   95 camera MTF calibration data-   96 camera ICC profile-   98 thumbnail image data-   100 advanced edits list-   102 application segment-   122 DRAM buffer memory-   128 firmware memory-   130 flash-   132 color display-   134 user controls-   140 gravitational orientation sensor-   162 dock interface-   200 block-   202 block-   204 block-   206 block-   208 block-   210 block-   212 block-   214 block-   216 block-   220 block-   222 block-   224 block-   226 block-   228 block-   230 block-   232 block-   234 block-   358 home photo printer-   360 retail photo printer-   364 dock/recharger-   400 sensor CFA data-   402 sensor defect correction-   404 CFA image resampling-   406 TIFF raw file formatting-   408 CFA data cropping-   410 sensor noise cleaning-   412 color sensor demosaicing-   414 white balance-   416 tonescale/color processing-   418 sharpening-   420 JPEG compression-   422 Exif file formatting-   424 thumbnail & screennail resampling-   426 JPEG compression-   428 digital zoom/pan settings-   430 noise cleaning thresholds-   432 rotate/resample settings-   434 white balance settings-   436 tone & color settings-   438 sharpening settings-   440 compression settings-   444 image processing parameters-   448 TIFF tag formatting-   450 digital image file-   502 TIFF header-   504 IFD0-   506 JPEGInterchangeFormat Pointer-   510 main Exif/JPEG data-   512 main image-   514 screennail image-   516 thumbnail image-   520 ExifIFDPointer-   522 ExifIFD-   524 IPParamIFDPointer-   526 IPParamIFD-   528 SubIFDPointer-   530 Child 0^(th) SubIFD-   532 strip offset-   536 main CFA data-   540 Child 1^(st) SubIFD-   542 strip offset-   544 small size CFA data-   550 NextIFD-   552 IFD1-   554 IPParamIFD-   556 NextIFD-   558 Main Exif/JPEG data-   560 Last IFD pointer-   562 IFD2-   564 IPParamIFD-   568 Main Exif/JPEG data-   570 additional modified JPEG images

1. An electronic image capture device for capturing a color image,comprising: an image sensor comprised of discrete light sensitivepicture elements overlaid with a color filter array (CFA) pattern toproduce sensor color image data corresponding to the CFA pattern; an A/Dconverter for producing uninterpolated digital CFA image data from thesensor color image data; a processor for processing the uninterpolateddigital CFA image data to produce interpolated image data and forforming a TIFF image file containing both the uninterpolated CFA imagedata and the interpolated image data; and a memory for storing the TIFFimage file.
 2. The image capture device as claimed in claim 1 whereinthe interpolated image data is stored in a JPEG compressed bitstreamwithin the TIFF image file.
 3. The image capture device as claimed inclaim 1 wherein the processor uses at least one parameter to perform theimage processing operations used to produce the interpolated image data,and the TIFF image file further stores the at least one parameter. 4.The image capture device as claimed in claim 3 wherein the processorsharpens the interpolated image data, and the TIFF image file stores aparameter specifying the amount of sharpening.
 5. The image capturedevice as claimed in claim 3 wherein the processor adjusts the whitebalance of the interpolated image data, and the TIFF image file stores aparameter specifying the white balance adjustment.
 6. The image capturedevice as claimed in claim 1 wherein the TIFF image file also storesdata that defines the type of color filter array pattern used on theimage sensor.
 7. The image capture device as claimed in claim 1 whereinthe processor also produces a reduced size, uninterpolated CFA imagedata, and the TIFF file also contains the reduced size uninterpolatedCFA image data.
 8. A single image file for storing images obtained froma color image capture device having an image sensor overlaid with acolor filter array (CFA) pattern to produce uninterpolated CFA imagedata corresponding to the CFA pattern, the CFA image data subject tofurther processing to form interpolated and compressed image data, saidsingle image file comprising: a first file area for storing theuninterpolated CFA image data; a second file area for storing theinterpolated and compressed image data as JPEG image data within thesingle image file; and a third file area for storing a first imageprocessing parameter used to produce the interpolated and compressedimage data.
 9. The single image file as claimed in claim 8, wherein thesingle image file also includes a fourth file area for storing modifiedinterpolated and compressed image data, and a fifth file area forstoring a second image processing parameter used to produce the modifiedinterpolated and compressed image data.
 10. The single image file asclaimed in claim 8, wherein the single image file is a TIFF file. 11.The single image file as claimed in claim 10, wherein the single imagefile is a TIFF/EP file.
 12. The single image file as claimed in claim10, wherein the first file area is a TIFF SubIFD area.
 13. A method forcapturing and processing color images, said method comprising: (a) in adigital image capture device, capturing an array of picture elementsthrough a color filter array (CFA) and producing CFA image data; colorimage data corresponding to the CFA pattern; (b) processing the CFAimage data using image processing parameter(s) stored in the digitalimage capture device to produce interpolated image data; (c) storing asingle image file in a memory of the digital image capture device, thesingle image file including the CFA image data, the interpolated imagedata, and the image processing parameter(s); (d) transferring the singleimage file to a second device; (e) determining whether the second deviceis capable of processing the CFA image data; and (f) if the seconddevice is capable of processing the CFA image data, accessing the CFAimage data and the image processing parameter(s) in the single imagefile.
 14. The method of claim 13 further including: (g) if the seconddevice is not capable of processing the CFA image data, accessing theinterpolated image data in the single image file;
 15. The method ofclaim 13 further including: (h) modifying the image processingparameter(s) and processing the CFA image data using the modified imageprocessing parameter(s) to produce modified interpolated image data. 16.The method as claimed in claim 15 further including (i) storing themodified image processing parameters and the modified interpolated imagedata in the single image file.
 17. The method as claimed in claim 15further including: (j) printing the modified interpolated image data.18. The method according to claim 13 wherein the single image file is aTIFF compliant file.
 19. The method according to claim 18 wherein theinterpolated image data is stored as JPEG compressed image data.
 20. Themethod according to claim 18 wherein the digital image capture devicealso produces a reduced size CFA image, and stores the reduced sized CFAimage data in the single image file.